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ABSTRACT 

Vald's  Sequential  Decision  Theory  is  applied  to  voice 
communication  systems  of  the  quantized  pulse  position  modu- 
lation type.  When  interference  is  narrow-band  Gaussian 
noise,  two  sequential  systems  are  considered.   The  "Double 
Threshold,  Speech  Statistics"  system  divides  the  speech 
sampled  frame  into  N  discrete  slots.   The  three  decision 
zones  for  each  slot  are:   (1)  signal  is  present,  (2)  signal 
is  possibly  present,  and  (5)  signal  is  not  present.  If  the 
end  of  the  frame  has  produced  no  decision  for  the  first 
zone,  the  receiver  chooses  one  from  the  group  representing 
the  second  decision  zone.   This  choice  is  made  on  the  basis 
of  the  one  most  likely  to  be  the  signal,  as  indicated  by 
speech  statistics. 

The  "Double  Threshold,  Largest  of  S"  system  is  the 
other  sequential  type.  It  is  similar  to  the  previously  des- 
cribed technique,  with  the  exception  that  when  the  choice 
must  be  made  from  the  group  representing  the  second  decision 
zone,  it  is  made  on  the  basis  of  the  largest  one.  When 
compared  to  the  conventional,  single  threshold  method,  the 
sequential  systems  provide  a  reduction  of  about  1.5  decibels 
in  required  signal-to-noise  ratio  for  a  specified  probability 
of  error.   Their  performance  is  almost  as  good  as  a  "Largest 
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of  N"  receiver,  which,  considers  all  IT  slots  and  chooses  the 
largest  as  signal.   The  sequential  methods  seem  to  represent 
a  compromise  between  these  two  techniques,  having  some 
features  of  each. 

When  interference  is  narrow-band  Gaussian  noise,  with 
occfisional  impulse-like  large  amplitude  pulse  noise,  the 
sequential  systems  have  four  thresholds.   Thus  the  "signal 
is  possibly  present"  and  the  "signal  is  not  present"  decision 
zones  consist  of  two  separate  parts  for  each.   The  two 
sequential  types  are  the  speech  statistics  and  the  neairest 
to  reference  systems.  The  reference  referred  to  is  the 
decision  zone  representing  signal  present.  Analysis  is  made 
on  the  basis  of  a  mathematical  model  consisting  of  a  Poisson 
distribution  for  the  number  of  impulses  in  a  frame,  with  an 
average  number  of  one,  and  a  modified  Rayleigh  distribution 
for  the  envelope  of  the  impulse-like  interference,  with 
amplitude  of  the  pulse  three  times  the  signal  pulse. 

The  error  performance  of  the  conventional  single 
threshold  and  the  "Largest  of  U"  receivers  is  shown  to  be 
completely  inadequate  under  these  conditions,  A  conventional 
receiver  modified  to  include  an  upper  threshold  for  discrimi- 
nation against  impulses  gives  a  reasonable  performance.   The 
sequential  methods,  however,  give  an  improvement  of  about 
2,0  decibels  over  this.  Roughly  equivalent  to  this  improve- 
ment is  that  given  by  a  "Largest  of  N"  system  which  is 
modified  to  include  an  upper  threshold  for  impulse  removal. 
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The  conclusion  reached  is  that  sequential  techniques 
in  the  form  described  provide  an  improvement  over  conventional 
or  modified  conventional  methods.   The  improvement  is  probably 
not  large  enough  under  most  circumstances  to  warrant  their 
use.  However,  specific  situations  may  allow  their  beneficial 
application.  It  is  felt  that  further  study  should  be  made  of 
sequential  techniques  for  other  modulation  methods  in  voice 
communications,  possibly  in  other  forms  from  those  described 
here. 
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CHAPTER  I 
INTRODUCTIOH 
The  Beginnings  of  Sequential  Analysis 

'    The  voice  communication  systems  discussed  in  this 
report  have  resulted  from  efforts  to  apply  the  ideas  of 
sequential  analysis  to  this  field  of  study.   It  is  there- 
fore appropriate  to  relate  in  this  initial  chapter  some  of 
the  background  information  on  sequential  analysis,  and  to 
descrihe  some  earlier  applications  of  this  theory. 

Whether  in  radar,  data,  or  pulse-coded  voice 
communications  the  basic  problem  is  the  detection  of  a 
signal  in  noise.  When  the  examination  of  the  random  process 
is  to  provide  a  positive  or  negative  indication  as  to  the 
presence  of  a  signal  the  problem  may  be  considered  a  test 
of  statistical  hypotheses.   That  is,  based  on  the  available 
information  a  choice  is  to  be  made  between  hypothesis  H  : 
signal  is  not  present,  and  H-j_:   signal  is  present.   This  may 
involve  a  statistical  test  of  a  mean,  a  signal-to-noise 
ratio,  etc.   Sequential  analysis,  including  the  sequential,  . 

probability  ratio  test,  was  devised  by  Abraham  Wald  for 

2 
hypothesis  testing.  He  and  Wolfowitz  showed  that  this  test 

requires  on  the  average  fewer  samples  to  terminate  than  do 


tests  of  fixed  sample  size,  for  equal  probabilities  of  error. 
A  distinguishing  feature  of  tbe  test  is  that  it  is  conducted 
in  stages,  with  the  length  not  specified  in  advance,  but 
determined  by  the  progress  of  the  test.   Thus  the  sample 
size  is  a  random  variable.  Although  the  length  of  the  test 
is  smaller  on  the  average  than  that  for  any  other  test,  it 
may  be  very  Isirge  for  a  particular  trial.   Stein^  showed 
that  not  only  is  the  expected  length  of  a  sequential  test 
finite,  however,  but  all  moments  of  the  length  are  finite 
if  the  samples  are  independent.  Thus  the  question  was 
resolved  as  to  whether  sequential  tests  terminate. 

Because  the  length  of  a  particular  test  may  be  longer 
than  can  be  tolerated,  many  practical  situations  require 
that  a  test  be  terminated  prematurely.   At  the  point  of 
truncation,  some  alternate  criterion  is  adopted  so  that  a 
choice  of  hypothesis  may  be  made.   A  truncated  test  requires 
on  the  average  a  smaller  number  of  samples,  but  the  error 
performance  is  worse  than  for  the  untruncated  sequential 
test.   Truncation  represents  a  compromise  between  the 
completely  sequential  test  and  the  fixed-sample  test. 

Description  of  the  Sequential  Test 

We  let  X.  be  the  random  variable  representing  a 
sample  of  a  random  process  for  which  a  statistical  decision 
problem  is  formulated.   Sample  X,  is  independent  of  any 


other  sample  X.  for  ±  4  0*      Tiie  successive  samples  of  X  are 
denoted  "by  X,  ,  Xp,  ...  .   The  joint  probability  density 
function  for  the  samples  is  considered  knovni,  except  for 
some  parameter  0  (or  a  set  of  parameters  0  in  the  general 
case),  and  is  represented  by  W  (X;0).   The  subscript  indi- 
cates that  the  experiment  is  at  the  mtt  stage.  Based  on  the 
sequential  test  a  choice  is  to  be  made  between  two 
hypotheses:  H  ,  the  value  of  0  is  0  ;  and  H,  ,  the  value  of 
0  is  0-,  .   Therefore,  if  hypothesis  H  is  true  the  joint 
probability  density  function  of  the  m  samples  is  V  (X;0  ); 
if  hypothesis  H-,  is  true  the  density  is  V  (X;0,).   If  the 
a  priori  probability  that  H  is  true  is  p,  then  the  a  priori 
probability  that  H-,  is  true  is  1  -  p.  More  generally,  of 
course,  there  could  be  more  than  two  hypotheses  from  which 
to  choose.  Here  we  are  interested  in  the  binary  case  only. 
The  likelihood  ratio  at  the  mto  stage  of  the  experi- 
ment is  defined  by 

(1  -  p)W^(X;0^) 
^"^  "  p  V^(X;0^)  ^^-^^ 

The  carrying  out  of  the  sequential  test  requires  this 
likelihood  ratio  to  be  computed  at  each  stage  of  the  experi- 
ment. Two  threshold  numbers  A  >  1  and  B  <  1  are  chosen. 
At  the  mti»  stage  the  decision  is  made  to  continue  the  test  if 

b'  <  A^<    ^  ,  f or  m  =  l,2,...,n  -  1  .  (1.2) 


The  test  is  terminated  and  hypothesis  H  accepted  if  at  the 
n^J  trial 

A^^  B^  .  (1.5) 

Similarly,  hypothesis  H,  is  accepted  at  the  ntt  trial  and 
the,  test  terminated  if 

Observe  that  if  we  set  B''  =  ^-^  "  ^^  B  and  ^    =  ^^   "  ^^  A 

P  P 

the  sequential  test  can  be  set  up  in  terms  of  the 
conditional  probabilities,  independent  of  the  a  priori 
probabilities  p  and  1  -  p.   This  can  be  seen  by  considering 
the  probability  ratio 

Am  =   ,-  \  (1.5) 

Note  that  K^   is  — ^-^Xqi  •   The  test  procedure  is  thus 
slightly  modified.   At  the  m«>  stage  the  decision  is  made  to 
continue  the  test  if 

'^^   Aj^<  A      ,  for  m  =  1,2,. ..,n  -  1  .    (1.6) 

The  test  is  terminated  and  hypothesis  H  accepted  if  at  the 
nu»  trial 

Xq^  B  .  (1.7) 

Similarly,  hypothesis  H,    is  accepted  at  the  nUi  trial  if 

\^^    A      .  (1.8) 


The  standout  feature  of  the  sequential  test  is  the 
dividing  of  the  decision  zone  into  three  parts  (by  means  of 
the  two  thresholds).   These  are:   (1)  a  zone  of  acceptance 
for  H  ,  (2)  a  zone  of  acceptance  for  H-,  ,  and  (3)  a  zone  of 
indifference.   The  conventional  fixed-number-of-samples 
test  has  associated  with  it  only  the  two  zones  of  acceptance 
and  one  threshold.  As  pointed  out  above,  the  sequential 
test  provides  a  savings,  on  the  average,  in  the  required 
number  of  samples  for  given  probabilities  of  error. 

The  two  types  of  error  possible  are  the  acceptance 
of  H  when  H,  is  true  and  the  acceptance  of  H^  when  H  is 
true,  Wald  has  showed  that  the  thresholds  A  and  B  depend 
on  these  probabilities  of  error.   The  procedure  followed 
in  the  conventional  sequential  test  is  to  select  acceptable 
error  probabilities,  thereby  determining  the  thresholds. 
Of  course,  the  smaller  the  error  probabilities,  the  larger 
the  average  test  length.  It  is  emphasized  at  this  point 
that  a  modified  form  of  the  conventional  sequential  test  is 
utilized  in  the  voice  communications  applications  discussed 
in  the  body  of  this  report.   The  several  variations  from 
the  conventional  will  be  explained  in  detail  in  the  following 
chapters. 


Radar  Application 

There  has  been  much  work  in  applying  the  sequential 
decision  theory  to  radar  systems.   In  the  radar  problem,  the 
system  decides  on  the  presence  or  absence  of  a  target  in  a 
particular  region  of  space  during  a  pSLrticulsir  time  period. 
Based  on  the  signal  received  at  the  set,  it  may  not  be 
clear  as  to  whether  this  is  from  the  radar  pulse  returned 
from  a  target  or  whether  it  is  noise  alone.   In  this  case, 
the  radar  continues  to  "look"  until  a  decision  can  be  made. 
Vald's  theory,  when  considered  from  the  point  of  view  of 
detecting  a  radar  signal  in  noise,  offers  a  saving  in  the 
time  required  to  make  a  decision  within  certain  tolerable 
error  limits  as  to  the  presence  or  absence  of  a  target. 

Sequential  detection  of  signals  in  noise  falls  into 
the  general  domain  of  Statistical  Decision  Theory.  Van  Meter 
and  Middleton  studied  the  general  application  to  the 

reception  problem  of  decision  theory.  Blasbalg,  Fox,   and 
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Bussgang  and  Middleton'  have  made  valuable  contributions 

with  their  works  involving  sequential  signal  detection. 

Much  of  the  discussion  here  of  the  radar  application  will 
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follow  the  results  of  Bussgang  and  Middleton. ' 

For  radar,  the  parameter  for  which  the  sequential 
test  is  performed  is  the  input  signal-to-noise  ratio  a. 
Thus  the  two  hypotheses  being  considered  are  H  :   the  value 
of  a  is  zero,  and  H^:  the  value  of  a  is  greater  than  zero. 


Acceptsince  of  H  (rejection  of  H,  )  is  a  decision  that  no 
target  is  present.   This  is  a  "dismissal."  Acceptance  of 
H-,  (rejection  of  H  )  is  a  decision  that  a  target  is  present. 
This  is  an  "alarm."  As  expected,  the  decision  to  accept  H, 
is  more  likely  to  be  made  as  a  is  increased.   A  preset 
signal-to-noise  ratio  a,  is  used  to  set  up  the  sequential 
test.   The  value  a,  is  such  that  for  a  less  than  a,  ,  an 
acceptance  of  H  is  not  too  oh jecti enable.   The  test  involves 
selecting  tolerable  values  for  ex  ,  the  probability  of  a  false 
alarm,  and  f or /^  ,  the  probability  of  a  false  dismissal. 
The  quantity /3   is  determined  by  the  probability  of  dismissal 
for  a  =  a,  .   Sometimes  o^   and /3  are  called  the  probabilities 
of  error  of  the  first  and  second  kind,  respectively.   The 
"strength  of  the  test"  refers  to  these  two  probabilities  of 
error  and  is  denoted  by  (ex'  ,/S).  The  test  is  regarded  as 
stronger  as  <x:  ,  /Q  are  made  smaller. 

At  this  point  we  will  consider  the  incoherent  se- 
quential detection  of  the  radar  signal  in  noise.  Following 
this  will  be  a  discussion  of  coherent  sequential  detection. 
For  incoherent  detection  no  phase  information  is  available 
at  the  receiver.   The  random  variable  of  interest  is  the 
envelope  of  a  narrow-band  Gaussian  noise  plus  a  sine  wave 
at  the  center  frequency  of  the  noise  band.   The  appropriate 
probability  density  function  for  this  envelope  R  is  shown 
by  Hice  to  be 
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^  (R^  +  A^q)      /RA, 


V(R;A^)  =  -^ ^  .  I  -^  for  R  ^  0   (1.9) 

2 
where  ^   is  the  mean-square  value  of  noise  at  the  i-f 

filter  and  I^  (u)  is  the  modified  Bessel  function  of  the 

0 

first  kind  and  of  order  zero.  A  is  the  peak  amplitude  of 
the  sine  wave.   For  the  envelope  of  noise  alone  (A  =0), 
the  density  function  is 


2 

VCR;0)  =  -^ ^—2  for  R  5^  0     (1.10) 

n       n 
These  are  the  Hayleigh  distributions.  The  true  signal-to- 
noise  ratio  a,  which  is  the  unknown  parameter  of  these 

densities,  is 

A^ 
a  =    °  (1.11) 


y2^n 


If,  for  convenience,  we  change  the  random  variable  from 

H 


l^^n 


to  X,  the  densities  become 


.e-C^^-^^). 


V(x;a)  =  2x  'e  ^-  *  "^   ^  .  I^(2ax)    ,   x^  o 

(1.12) 
=  0  ,  X  <  o   . 

From  this  the  probability  ratio  A      can  be  found,  smd  the 
test  carried  out  in  terms  of  the  threshold  numbers  A  and  B. 
An  alternate  procedure  involves  the  consideration  of  the  . 


test  in.  terms  of  the  logarithm  of  the  probability  ratio. 
For  this  case,  the  zone  of  indifference  is  bounded  by  log  A 
and  log  B. 

Under  the  usual  condition  of  independent  samples, 
the  two  error  probabilities  are 

o(    =  j^n.pC./H,  •.  o).[5-|£-e^^-c^«j  .  (1.15) 


a 


00 


[J^.e-^-..] 


n-l 


l^-e  4--^'  T  (£^A 


i.. 


<^y, 


(LK 


(1.1^) 


In  the  above,  oe   and ^6  are  expressed  in  terms  of  the  actual 
signal  level  thresholds  a  and  b.  Even  though  n,  the  final 
stage  of  the  test,  is  a  discrete  random  variable  assuming 
integer  values,  it  is  convenient  to  consider  it  as  a  con- 
tinuous variable.   Thus  p(n/H,  ;a)  represents  the  conditional 
probability  density  function  of  n  under  the  condition  that 
H,  (k  =  0.1)  is  accepted.   The  true  value  of  the  signal-to- 
noise  ratio  a  is  also  required  to  specify  this  density. 
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Simplification  of  the  error  probability  expressions 


yields 


00 


b*  ,n-.    .^ 


^=  J^n.p(%,  ;o).[e  ^''n'.  e^'"""]"  •  c"'"'^''*      (1.15) 

o 

OO 

(1.16) 

Q 

where  Q(x,y)  is  defined  by  Marcum^  as 


.2.   „i 


(x,^)  =  3ve  *-  .  lo(xv)-  <iv 
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Bussgang  and  Middleton  have  studied  this  case  ex- 
tensively.  They  show  hov;  the  average  number  of  samples 
required  increases  as  the  probabilities  of  error  are  lowered. 
The  savings  in  average  number  of  observations  is  paid  for  in 
the  sample  length's  becoming  random.   The  larger  the  variance 
of  the  sample  length,  the  greater  the  savings  in  average 
length.   As  the  variance  gets  smaller  the  savings  is  reduced 

and  the  sequential  test  approaches  a  non- sequential. 

7 

Similarly,  Bussgang  and  Middleton'  have  thoroughly 

studied  the  sequential  coherent  detection  case.   Here,  of 
course,  it  is  assumed  that  the  receiver  has  complete  signal 
phase  information.   Statistically,  the  problem  is  the  testing 
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of  the  mean.   Under  H  the  true  mean  is  zero:  for  E-,    the 

o  1 

mean  is  the  value  of  the  signal  at  the  sampling  time.   The 
general  technique  for  the  test  does  not  change.   The 
probability  ratio  is  constructed  and  tested  against  the  two 

threshold  numbers  as  before.   The  density  functions  for 

7 
this  case  are  Gaussian.  Bussgang  and  Middleton'  treat  the 

general  case  of  correlated  samples,  and  give  as  an  example 

the  case  with  an  exponential  autocorrelation  function. 

It  is  interesting  to  note  the  results  of  the  compari- 
son between  the  sequential  coherent  and  sequential  non- 
conherent  detectors.  For  signals  smaller  than  the  preset 
value  a,  ,  the  coherent  detector  is  less  likely  to  give  a 
false  dismissal  than  the  non-coherent.   In  many  cases  this 
difference  is  very  great.  For  signals  larger  than  the 
preset  value,  the  coherent  detector  is  more  likely  to  give 
a  false  dismissal. 

In  the  comparison  of  the  average  number  of  samples, 

it  is  found  that  in  the  weak  signal  case  this  average  number 

2 
depends  on  a  for  the  coherent  test  and  on  a  for  the  non- 
coherent.  As  an  example  of  how  this  affects  the  average 


sample  number,  Bussgang  and  Niddleton'^  plotted  a^  n(a)  fo37 
coherent  and  a-,   n(a)  for  non-coherent  versus  a/a^.  The 
peaks  of  the  two  curves  are  the  same  but  occur  at  different 
values  of  a/a,  .   Since  the  case  considered  is  for  a^  very 
small,  the  coherent  sequential  detector  therefore  requires 
fewer  average  samples  at  this  peak  value. 
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For  tlie  radar  case,  any  truncation  of  tb.e  test  re- 
quired would  normally  be  set  for  some  large  number  of 
samples.   The  result  v/ould  be  a  test  very  close  to  the 
untruncated  one.   When  a  test  is  truncated  the  average 
number  of  samples  required  to  terminate  is  reduced.  How- 
ever the  strength  of  the  test  (  o'  ,  /3  )  is  reduced  to  ( «>^^  ,  /J  ) 

Complicated  expressions  relating  o(   to  o<^   and /5  to  /3    have 

7 

been  derived,  but  they  will  not  be  repeated  here. 

Data  Application 

Data  applications  of  the  sequential  theory  are  dif- 
ferent in  several  respects  from  the  radar  case.   The  most 
conspicuous  difference  is  the  use  of  a  feedback  channel  for 
data.   The  receiver  employs  three  decision  zones  as  before: 
a  zone  of  acceptance  of  H  ,  a  zone  of  acceptance  of  H, ,  and 
a  zone  of  indifference.  Here  H  represents  the  hypothesis 
that  one  of  the  binary  data  symbols  was  transmitted,  while 
H,  represents  the  hypothesis  that  the  other  symbol  was  sent. 

The  feedback  channel  is  used  whenever  there  is  a 
reception  falling  in  the  zone  of  indifference.   Whenever 
this  situation  occurs,  the  receiver  notifies  the  transmitter 
over  the  feedback  channel  that  it  is  not  clear  which  symbol 
v;as  sent.   The  transmitter  repeats  this  symbol  and  the 
decision  process  starts  over.   The  transmitter  then  either 
goes  on  to  the  next  symbol  or  repeats  the  same  symbol. 
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depending  on  the  decision  at  the  receiver.  With  probability- 
unity,  the  transmitter  can  eventually  go  on  to  the  next 
symbol,  although  in  specific  instances,  a  long  time  may  be 
required. 

When  compared  to  the  method  of  repetition  a  fixed 
number  of  times,  it  is  seen  that  the  sequential  technique 
provides  a  savings  which  can  be  realized  in  increased  data 
rate  or  reduced  necessary  signal  power  for  a  given 
probability  of  error. 

The  receiver  of  the  standard  sequential  system 
utilizes  all  past  samples  in  deciding  which  signal  is 
present  and  if  another  sample  is  required  to  give  more 
accuracy.   A  modified  form  of  this  has  received  much 
emphasis  in  the  literature.   The  technique  referred  to  is 
the  sequential  test  without  memory,  usually  called  null- 
zone  detection. 

In  null-zone  detection,  the  same  three  choices  of 
decision  are  available  to  the  receiver.  However,  only  the 
most  recent  sample  is  available  on  which  to  base  the 
decision.   For  this  situation  there  is  a  non-zero 
probability  that  the  receiver  would  continue  asking  for  a  _ 
repeat  of  a  particular  signal,  and  thus  never  move  on  to 
the  rest  of  the  message.   Consideration  of  truncation 
becomes  very  important  here. 

Harris,  Hauptschein,  and  Schwartz   have  extensively 
studied  the  null-zone  detection  problem.   Among  other 
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aspects  of  the  problem  they  studied  the  manner  in  v:hich  the 
threshold  levels  should  be  adjusted  in  order  to  minimize 
communication  costs.   These  costs  depend  on  power, 
bandwidth,  and  transmission  time.   For  non-truncation  the 
uniform  null  (no  adjustment)  is  optimum.   For  truncation, 
hov/-ever,  the  levels  should  be  adjusted  for  each  sample  so 
that  the  probability  of  the  sample  falling  in  the  null 
zone  is  reduced  over  the  previous  sample.   They  show  that 
the  loss  is  small,  however,  if  no  adjustments  are  made. 

In  these  studies  the  feedback  channel  is  usually 
considered  error-free.  This  is  reasonable  since  normally 
only  a  small  amount  of  information  compared  to  the  channel 
capacity  is  transmitted  over  it.   The  probability  of  error 
can  therefore  be  made  very  small, 

Boorstyn   has  also  studied  null-zone  detection, 
concentrating  his  efforts  on  the  case  of  extremely  small 
average  number  of  samples;  i.e.,  between  one  and  two.   For 
the  most  part  he  deals  with  situations  in  which  a  repeat 
is  required  only  a  small  fraction  of  the  time,  and  only 
one  repeat  is  allowed.  He  demonstrates  that  even  for  these 
small  average  sample  sizes  a  significant  improvement  is 
obtained. 

Voice  Systems 

With  the  above  providing  the  background  a  description 
will  now  be  given  of  the  voice  communication  systems  which 
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have  been  devised  from  consideration  of  the  sequential 
techniques.   Just  as  there  are  differences  between  the  radar 
and  data  sequential  systems,  so  are  the  voice  systems  dif- 
ferent from  them  in  several  respects. 

Search  of  the  literature  shows  no  previous  successful 
efforts  along  these  lines.   The  problem  is  of  a  somewhat 
different  nature  from  the  radar  or  data  problems.  With 
speech  there  is  not  enough  time  to  allow  for  many  samples 
before  making  a  decision,  as  in  the  radar  case.   But, 
instead,  a  decision  must  be  made  during  every  speech  sample 
interval.  Similarly,  no  provision  can  be  made  for  a  feed- 
back communications  path,  as  in  the  data  case,  for  the 
purpose  of  requesting  a  retransmission.   (Of  course,  in 
duplex  communications  the  listener  can  simply  request  that 
a  word  or  sentence  be  repeated,  but  here  a  particular 
sample  of  the  voice  wave  is  being  referred  to  in  the 
preceding  statement.) 

All  of  the  discussion  here  will  be  concerned  with 
systems  of  the  quantized  pulse  position  modulation  type 
(QPPM);  i.e.,  information  regarding  the  speech  amplitude  at 
the  sampling  instant  is  denoted  by  transmitting  the  pulse  . 
in  a  particular  one  of  the  N  discrete  pulse  position  slots 
in  the  speech  sample  interval.   The  pulse  will  be  detected 
incoherently.   It  is  believed  that  techniques  similar  to 
those  described  here  can  also  be  applied  to  other  types  of 
modulation,  but  this  will  be  left  for  future  study. 
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Two  cases  will  "be  discussed.   First,  th.e  interference 
will  be  considered  to  consist  of  a  narrow-band  Gaussian 
noise.   A  double  threshold  QPPM  sequential  system  is  des- 
cribed in  Chapter  II  which  is  effective  against  this  type 
of  interference.   Second,  the  interference  is  a  narro\\r-band 
Gaussian  noise  and  an  impulsive  noise.   In  Chapter  III  is 
described  the  four-threshold  level  (^PM  sequential  system 
which  effectively  combats  this  kind  of  interference. 

In  each  case,  the  decision  zones  are  of  the  three 
usual  types:   signal  present,  signal  absent,  and  the  zone 
of  indifference.  The  receiver  must  examine  the  K  pulse 
position  slots  sequentially  during  each  speech  sample 
interval,  beginning  with  the  first  slot  and  continuing 
through  the  N^!  slot  or  through  the  termination  slot  if 
termination  occurs  before  the  end  of  the  frame.   During  the 
time  a  slot  is  being  examined,  only  one  sample  is  available 
from  which  hypothesis  H  or  hypothesis  H,  is  decided  if 
possible.   At  this  stage,  the  receiver  is  acting  like  the 
null-zone  detector  of  the  data  case  (the  sequential  test 
without  memory). 

If  hypothesis  H-,  is  accepted  for  the  slot  under 
examination  (the  decision  is  made  that  this  slot  contains 
the  signal)  the  test  is  terminated  until  the  next  speech 
frame  begins.   Acceptance  of  H  for  a  slot  does  not  termi- 
nate the  test.   This  is  a  difference  from  the  previous  cases 
discussed. 
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The  receiver  has  memory  of  those  slots  for  xvhich  the 
sample  falls  into  the  zone  of  indifference.   Use  is  made  of 
this  information  for  those  frames  in  which  no  slot  sample 
calls  for  acceptance  of  H,  .   That  is,  at  the  end  of  the  Nib 
slot,  if  no  slot  has  been  chosen  as  definitely  having  the 
signal,  a  choice  v/ill  then  "be  made  from  only  those  slots 
which  were  not  rejected  by  choice  of  hypothesis  H  .   The 
test  is  therefore  truncated  after  N  slots. 

There  are  alternative  criteria  available  for  use  in 
choosing  the  signal  slot  from  the  several  "possible  signal" 
slots.  Use  may  be  made  of  speech  statistics  for  this 
choice,  for  example.   Samples  of  the  speech  wave  represent 
a  Markov  process.   The  probability  density  function  for  a 
sample  is  conditional  upon  the  amplitudes  of  the  preceding 
samples.   Therefore,  for  example,  based  on  the  position  of 
the  pulse  in  the  previous  frame,  that  one  of  the  "possible 
signal"  slots  could  be  chosen  which  represented  the  most 
probable  slot.   The  mathematical  model  used  for  the  speech 

marginal  and  conditional  probability  density  functions  is 
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based  on  the  experimental  results  of  Davenport.    A  more 

complete  and  detailed  discussion  of  this  model  is  given  in. 

Appendix  A. 

For  the  double  threshold  level  situation,  an  alternate 

criterion  is  to  make  the  choice  from  the  "possible  signal" 

slots  on  the  basis  of  the  one  with  the  largest  amplitude 

pulse. 
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For  the  four  thresliold  level  situation,  a  possible 
criterion  is  to  make  the  choice  on  the  basis  of  the  slot 
whose  pulse  amplitude  is  nearest  to  the  range  of  amplitudes 
representing  acceptance  of  H,  .   Other  criteria  are  possible, 
but  these  are  the  ones  considered  in  this  study. 

,    For  all  of  these  there  is  a  non-zero  probability  that 
all  slots  in  a  frame  represent  acceptance  of  H  .   \^^hen  this 
occurs  the  receiver  chooses  the  center  slot  (the  Nib)  and 
proceeds  to  the  next  frame. 

Of  primary  interest  is  how  these  systems  compare  to 
conventional  OJ'PM  systems.   The  ti-;o  standard  qPPIi  methods 
are  the  single  threshold,  incoherent  detection  type,  and 
the  largest  of  N  type,  without  a  threshold.   In  the  first, 
the  receiver  selects  as  the  signal  slot  the  first  slot 
whose  pulse  amplitude  exceeds  the  threshold.   In  the  second, 
the  receiver  selects  as  the  signal  slot  that  one  whose  pulse 
amplitude  is  the  largest. 

For  comparison  purposes  there  are  many  criteria 
possible,  such  as:   (1)  output  signal-to-noise  ratio,  (2) 
bandwidth  required,  (3)  average  cost  in  the  Bayes  sense, 
(4-)  complexity,  and  (5)  probability  of  correctly  choosing 
the  proper  slot.   For  mathematical  tractability,  the  latter 
one  is  used  in  this  study. 

In  addition  to  the  comparisons  reported  here,  para- 
metric studies  of  the  systems  are  also  given.  For  various 
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input  signal-oo-noise  ratios,  the  thresliold  settings  are 
allowed  to  vary  and  the  effect  noted  on  the  probability  of 
correct  choice.,   CDhe  difference  between  an  adaptive  and  a 
non-adaptive  system  can  also  be  seen.   The  sense  in  which 
the  systems  are  adaptive  is  that  the  threshold  settings  are 
self-adjusting  with  changes  in  the  noise  level  so  as  to  be 
optimum. 

Other  quantities  of  interest  are  the  mean  and  the 
variance  of  the  number  of  "possible  signal"  slots  from 
which  a  choice  is  to  be  made  if  no  "signal"  slot  is 
available.  These  have  a  bearing  on  the  complexity  of  that 
part  of  the  system  which  performs  this  task.   As  the 
thresholds  are  varied,  the  report  describes  the  variation 
of  these  quantities  with  particular  input  signal-to-noise 
ratios.  Also  of  interest  is  the  mean  of  the  number  of  slots 
before  termination  of  the  test. 

V7ith  this  chapter  providing  the  introduction,  the 
remainder  of  this  report  will  concern  itself  with  more 
details  of  the  system  descriptions  and  va.th  a  complete 
discussion  of  the  results. 


CHAPTER  II 

COWEI^TIONAL  AM)   SEQUENTIAL  SYSTEMS  WITHOUT 
IMPULSE  NOISE  CONSIDSIiATION 

Introduction 


In  this  section  is  a  discussion  of  four  QPPM  systems, 
with  the  interference  taken  to  be  narrow-band  Gaussian 
noise.   Tv/o  of  the  systems  are  conventional  types  while  the 
other  two  have  been  devised  from  a  consideration  of 
sequential  principles. 

It  should  be  noted  that  there  have  been  made  several 
modifications  of  the  sequential  techniques  as  used  in  radar 
and  data  for  these  voice  applications.   The  radar  receiver 
can  afford  a  very  large  number  of  samples  before  choosing 
a  hypothesis.   The  voice  receiver,  however,  must  make  a 
decision  no  later  than  the  end  of  each  speech  sampling 
frame.   Therefore,  for  voice  we  are  dealing  with  a  moderate 
number  of  samples  and  the  maximum  number  allov/ed  is  fixed. 

Minimization  of  the  average  number  of  samples  is  not 
the  primary  consideration  for  voice.   Instead  of  fixing  the 
values  of  the  two  types  of  error,  and  thereby  fixing  the 
thresholds  so  as  to  minimize  the  average  number  of  samples, 
v/e  now  vary  the  thresholds  to  obtain  a  minimum  probability 
of  error.   Of  course,  a  test  with  a  truncation  point  does 

20 


21 

not  have  fixed  thresliolds  for  minimization  of  average 
samples.   Tlie  thresholds  instead  should  move  closer  together 
in  some  manner,  not  yet  clear,  as  the  test  proceeds.   Thus, 
fixing  the  errors  for  fixed  thresholds  is  not  appropriate. 

The  data  application  allows  a  feedback  channel  for 
requesting  retransmission  of  a  questionable  reception.   For 
the  same  reason  that  the  voice  receiver  must  make  a  decision 
no  later  than  the  end  of  each  frame,  no  feedback  channel  can 
be  used  with  it. 

Another  difference  which  will  be  made  clear  in  the 
system  descriptions  is  that  the  test  terminates  only  with 
the  acceptance  of  the  signal  hypothesis.   Acceptance  of 
the  noise  alone  hypothesis  does  not  stop  the  test. 

QPPM,  Double  Threshold,  Speech  Statistics 

A  functional  diagram  of  this  system  is  given  in 
Figure  1.   The  signal  and  narrow-band  Gaussian  noise  are 
input  to  an  IF  filter  and  then  envelope  detected.   The 
optimum  decision  thresholds  will  be  shown  later  to  be 
adaptive  ones  in  the  sense  that  they  change  with  changing 
noise  level.   This  system  utilizes  two  thresholds,  0-   and  b, 
with  the  b  larger. 

During  each  of  the  N  pulse  slots,  the  receiver  is 
called  upon  to  attempt  a  choice  of  hypothesis.   If  the 
envelope  during  the  slot  is  greater  than  b,  the  signal 
hypothesis  H-,  is  chosen.   Thus  the  receiver  has  selected  a 
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slot  as  the  signal  slot.   The  remainder  of  that  frame  may 
now  be  blanked  out  and  possibly  used  for  the  reception  of 
non-real-time  data,  for  example.   The  receiver  stores  this 
slot  as  a  reference  for  the  following  frame  to  use  if 
necessary.   All  previous  slots  for  the  frame  which  were  in 
the' "possible  signal"  category  are  removed  from  storage  at 
this  time. 

If  the  envelope  is  below  a,  the  noise  alone  hypothesis 

H  is  chosen.   This  does  not  halt  the  test  for  the  frame,  but 
o 

removes  the  tested  slot  from  consideration  as  a  "possible 
signal"  slot.   At  the  end  of  the  frame,  if  all  slots  have  H^ 
associated  v;ith  them,  the  receiver  selects  the  center  slot 
as  the  desired  one. 

^Jhenever  the  envelope  is  betv/een  a.  and  b  for  a  slot, 
the  receiver  stores  this  as  a  "possible  signal"  slot,  and 
proceeds  to  the  next  slot.   If  some  follov/ing  slot  has  the 
signal  hypothesis  accepted,  this  information  is  removed  from 
storage.   If,  hov/ever,  at  the  end  of  the  frame  there  has 
been  no  selection  of  a  signal  slot,  this  slot  is  compared 
with  any  other  stored  "possible  signal"  slots.   By  using 
speech  statistics  the  slot  most  likely  to  be  the  signal  slQt 
is  then  chosen.   This  is  the  slot  nearest  to  the  position 
occupied  by  the  signal  of  the  preceding  frame,  as  stored  in 
the  receiver. 

The  speech  probability  expressions  required  are 


25 


developed  in  Appendix  A.      The   first   is   the  a  priori 
probability  that  the  signal   is   in  the   jiiJ   slot.      This   is 


P,W^o.3lte^-^-'^--ne*^-'^~  -'M 


oM^Hf-^j-erM"^)}] 


(2.1) 


where 


erf(x)=;j;|-Je  ""'  du.  (2.2) 

The  upper  sign  is  to  be  used  for  1  ^  j  ^  %  and  the  lower 

sign  for  ^  +  1  ^  0  ^  ^  • 

The  second  required  expression  is  the  probability 
that  the  speech  sample's  amplitude  corresponds  to  the  ^^ 
position,  given  that  the  previous  position  was  the^  ib. 
This  is  given  by 


2.  -  e"^ 


^  +  e     J 


[i-e  ^  ] 


± 
z  -  e^ 


-U-'Xi)      ^-.(.-i)] 


;  j=/    (2.3) 


The  desired  expression  for  the  probability  of  correct 
decision  during  a  frame  is  composed  of  three  parts: 
P, (cor)  =  P,  (correct,  signal  in  "signal"  zone) 

+  P,  (correct,  signal  in  "possible  signal"  zone) 
+  P,  (correct,  signal  in  "noise  alone"  zone) 

(2.^) 
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The  probability  of  a  correct  decision,  given  that  the 
signal  is  in  the  i^   sloi;  and  that  its  envelope  exceeds  b, 
is  the  probability  that  the  j-1  preceding  slots  with  noise 
alone  do  not  exceed  b.   The  probability  densities  of  the 
envelopes  of  narrow-band  Gaussian  noise  alone  and  sine  wave 
plus  noise  are  Rayleigh  and  Modified  Rayleigh,  respectively, 
as  discussed  in  Chapter  I.   Therefore, 
p.,  (correct,  signal  in  "signal"  zone) 

=  «(l'^)-f  PsW-['-e^V"  (2.5) 

where 

The  second  part  of  the  expression  is  more  complicated. 
Given  that  the  signal  envelope  is  in  the  "possible  signal" 
region  and  that  none  of  the  "noise  alone"  envelopes  exceed 
b,  we  can  develop  the  probability  of  a  correct  decision 
with  the  reference  slot  being  the  /  i!i.   v;e  have  to  consider 
only  ^  ^  ^  and  double  the  resulting  expression,  since  there 
is  an  equal  contribution  for  J'  >  ^  due  to  the  symmetry  of 
the  speech  first  probability  density.   Under  these  condi- 
tions, the  probability  of  correct  decision  is  the  probability 
that  none  of  the  noise  slots  closer  to  the  reference  than  the 
signal  slot  is,  are  in  the  "possible  signal"  zone.   For  the 
special  case  where  a  noise  slot  v;hich  is  "poosible  signal" 
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is  the  same  distance  from  the  reference  as  the  signal  slot 
is,  the  receiver  chooses  the  one  nearer  to  the  center  of 
the  frame.   The  range  of  values  for  j,  the  signal  slot,  must 
be  separated  into  three  parts:  d^i,/^+l^d-^2^, 
and  2;f  +  1  ^  J  ^  IT  .   The  result  is 

P,  (correct,  signal  in  "possible  signal"  zone) 
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(2.7) 


For  the  case  of  signal  in  the  "noise  alone"  region, 
the  probability  of  correct  decision  is  the  probability  that 
all  of  the  noise  envelopes  are  below  a   and  that  the  signal 
slot  is  the  center  one.  Therefore, 


P,  (correct,  signal  in  "noise  alone"  zone) 


(2.8) 
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Combining  th.e  three  contributing  parts  gives  tbe 
final  result 


H     .  r 

+  lP3(//)- 

J  =  -2/^/ 

^Ps(0['-Q(^'-t)Ki-e^-^-^] 


(2.9) 


The  expression  derived  above  for  the  probability  of  a 
correct  decision  has  considered  only  two  frames  at  any  one 
time.  Higher  order  speech  statistics  were  not  available  to 
allow  more  than  the  preceding  frame  to  be  used  for  reference 
purposes.   This  v/ould  seem  to  have  only  a  small  effect  and 
therefore  could  be  safely  neglected.   Furthermore,  the  fact 
that  the  reference  position  is  taken  to  be  correct  each 
time  is  acceptable  since,  for  the  practical  situation,  the 
probability  of  error  for  a  particular  frame  is  small. 

Another  quantity  of  some  interest  is  the  average 
number  of  slots  tested  before  termination  occurs.   This  is 
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K  =  2  K-  P{k)  (2.10) 

K=l 

where  P(K)  is  the  probability  of  termination  on  the  Ktb  slot. 
The  three  cases  to  be  considered  are:   signal  slot  is  the 
Kill,, signal  slot  is  before  the  Ktb,  and  signal  slot  is  after 
the  Kib.   A  termination  occurs  on  the  K^   slot  for  the  first 
case  if  the  signal  envelope  exceeds  b  and  none  of  the 
envelopes  of  the  preceding  K-1  slots  exceed  b.  For  the 
second  case,  the  signal  envelope  is  below  b,  as  well  as  the 
envelopes  of  the  first  K-2  noise  slots.  The  K^   slot  con- 
taining noise  alone  does  exceed  b.   The  last  case  requires 
the  first  K-1  slots  to  have  noise  envelopes  below  b,  with 
the  K^J  above  b.   Special  consideration  must  be  given  to  the 
termination  on  the  last  slot.   This  can  occur  from  the 
envelope  of  the  last  slot,  whether  signal  or  noise,  exceed- 
ing b  and  the  envelopes  of  the  other  slots  being  below  b. 
It  also  can  occur  due  to  the  test  truncation  requirement 
when  there  are  no  envelopes  exceeding  b  during  the  entire 
frame.   Consideration  of  these  facts  gives  the  result 
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Other  quantities  of  interest  are  the  mean  and  the 
variance  of  the  number  of  slots  with  envelopes  in  the 
"possible  signal"  zone,  when  no  slot's  envelope  exceeds  b 
during  the  entire  frame.   These  are  given  by 

5=  ^S-  ?<,S)  (2.12) 


5  =  1 


and 


5=) 

where  P(S)  is  the  probability  that  the  number  will  be  s» 
given  that  the  test  did  not  terminate  due  to  an  envelope 
being  above  b.   The  two  cases  to  be  considered  are  that  the 


31 

signal  slot  makes  up  one  of  the  s,  and  that  it  does  not  make 
up  one  of  the  s  slots.   It  is  thus  seen  that 

L»-Q(.-^>-^;j'L!-  e  ^'-.^  J 
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QPPM,  Single  Threshold ^  Conventional 

The  functional  diagram  for  this  system  is  given  in 

Figure  2.   The  output  of  the  envelope  detector  is  compared 

to  a  single  threshold  b  in  this  case.   The  slot  whose 

envelope  is  the  first  to  exceed  b  is  selected  as  the  signal 

slot.   That  is,  for  each  slot,  either  the  signal  hypothesis 

H,  or  the  noise  hypothesis  H  is  selected.  As  soon  as  a 

slot  has  H,  associated  with  it,  the  test  is  stopped  and  the 

remainder  of  the  frame  could  be  blanked  out.  Should  H^  be 

o 

selected  for  a  slot,  the  receiver  proceeds  to  examine  the 

next  one.  As  before,  if  all  slots  in  the  frame  lead  to 

choices  of  H  ,  the  receiver  chooses  the  center  slot  as  the 
o' 

signal  position. 
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The  probability  of  correct  decision  within  the  frame 
is  then  seen  to  be  the  probability  that  signal  envelope  is 
above  b  and  all  preceding  noise  envelopes  are  below  b,  or 
that  all  envelopes  are  below  b  and  signal  is  the  center 
slot.  Therefore, 

■  2. 

+  P,(^).[|-0(4;-|)].[|-e-'^"'J  (2.17) 


QPPM,  Double  Threshold,  Largest  of  s 

This  system  is  shown  in  Figure  5«  As  can  be  seen, 
it  is  very  similar  to  the  Speech  Statistics  system  of 
Figure  1.   In  fact,  they  are  identical  up  to  the  point  where 
a  hypothesis  has  been  chosen.  When  H,  is  chosen  for  a  slot, 
that  slot  is  selected  as  the  signal  slot.   The  remainder  of 
the  frame  is  blanked,  and  all  slots  stored  as  "possible 
signal"  slots  are  removed  from  storage.   Note  that  it  is 
not  required  that  the  signal  slot  be  stored  as  a  reference, 
because  a  new  criterion  is  used  for  resolving  the  "possible 
signal"  slots.   Choice  of  H  for  a  slot  removes  that  slot 
from  any  consideration  as  signal,  except  when  all  slots  are 
H  .  In  this  case  the  center  slot  is  used  as  signal.  One 
additional  storage  requirement  when  a  slot's  envelope  is  in 
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tlie  "possible  signal"  zone  is  that  the  envelope  amplitude, 
as  well  as  the  slot  position,  is  stored.   At  the  end  of  the 
frame,  if  there  has  "been  no  selection  of  H-,  ,  the  receiver 
selects  as  the  signal  slot  the  one  of  the  s  stored  whose 
envelope  is  largest. 

»    The  probability  of  correct  decision  for  this  case  is 
also  made  up  of  three  parts. 

P,(cor)  =  P,  (correct,  signal  in  "signal"  zone) 

+  P,  (correct,  signal  in  "possible  signal"  zone) 
+  P,  (correct,  signal  in  "noise  alone"  zone) 

(2.18) 
The  first  and  last  of  these  are  identical  to  the  first  and 
last  terms  of  P,(cor).   The  second  probability  is  the 
probability  that  j  of  the  noise  envelopes,  in  the  "possible 
signal"  zone,  are  less  than  the  signal  envelope,  also  in 
the  "possible  signal"  region,  while  the  remaining  noise 
envelopes  are  in  the  "noise  alone"  region.   That  is, 
P^  (correct,  signal  in  "possible  signal"  zone) 


(2.19) 


Now, 

]fX^^)■J^^.   =  J-f^.e-"^'-^^.  =  /-  e  ^""^         (2.20) 
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(2.21) 


By  the  binomial  expansion 

~  ■317-2.  ~?^2,  7 


[e-^^-e-^-^^^/=  X  (;)'(-//'e^''^^^"^^^e^^"^"'       ^^-^^^ 
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It  follows  that 


P^  (correct,  signal  in  "possible  signal"  zone) 
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If  now  we  let  /^/  +  1 • R  be  replaced  by  x,  the  integral  becomes 
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^0 


The  final  expression  is 


J=0  J=0 

> 

tP,(0[,-Q(^>^)J-[,^e^^f''  C2.25) 

The  appropriate  expressions  for  this  system  for  K, 

_       2 

s,  and  <r   are  identical  to  those  derived  previously  and 

given  in  equations  2.11,  2.15,  and  2.16,  respectively. 

QPPM,  Larp;est  of  IT 

This  system  is  functionally  described  in  Figure  ^o 
The  receiver  stores  the  N  envelopes  received  during  a  frame. 
At  the  end  of  the  frame  it  selects  as  the  signal  slot  the 
one  whose  envelope  is  largest. 

A  correct  decision  is  made  by  the  receiver  whenever 
all  of  the  noise  envelopes  are  below  the  signal  envelope. 
This  is  represented  by 
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Replacing  R-yK+l  by  x,   the  integral  iDecoines 
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Thus,   we  have 
N-l 
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K^o 
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^5 
Discussion  of  Results 

The  primary  result  of  this  chapter  is  depicted  in 
Figure  5.   This  allows  a  direct  comparison  to  be  made  for 
the  systems  discussed.   The  criterion  of  comparison  is 
minimum  probability  of  error  for  a  given  signal-to-noise 
input  ratio.   Thus,  the  curves  in  this  figure  are  based  on 
optimum  threshold  settings  for  the  given  noise  conditions. 

It  is  interesting  to  note  that  the  sequential  system 
based  on  speech  statistics  is  approximately  1.5  decibels 
better  than  the  conventional,  single  threshold  system, 
throughout  the  range  of  interest  of  signal-to-noise  ratios. 
The  sequential  system  based  on  a  largest  of  s  selection  is 
about  1.0  decibel  better  than  the  conventional.   Slightly 
better  than  these  is  the  system  based  on  selecting  the 
largest  amplitude  out  of  N  possible  choices.   This  is  a 
more  complex  system,  however,  and  therefore  has  its 
advantage  offset  to  some  degree.  It  will  be  shown  that  the 
average  value  of  s,  with  optimum  thresholds,  is  about  1  or 
2,   Therefore,  it  would  be  relatively  simple  to  select  the 
most  probable  signal  slot  out  of  s  under  these  conditions. 
Thus,  the  sequential  systems  offer  a  compromise  between  the 
simplicity  of  the  conventional  technique  and  the  higher 
theoretical  performance  of  the  largest  of  N  system.   The 
differences  noted  above  would  appear  to  be  insignificant 
under  most  circumstances.  However,  there  are,  foreseeably. 


FIGURE  5 

Probability  of  Error  for  Input  Signal-to-Noise  Ratios 
Between  4.0  and  14.0  Decibels,  Without  Impulse  Noise 
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situations  in  which,  use  of  the  sequential  systems  would  he 
advantageous. 

The  calculations  for  the  curves  of  Figure  5  were 
based  on  a  value  of  16  for  N.   To  obtain  an  indication  of 
what  changes  might  result  for  other  values,  single  points 
were  obtained  for  each  system  for  values  of  8  and  32  for  N. 
The  relative  changes  between  systems  in  the  probabilities 
of  error  are  about  the  same  amount.   As  a  result,  the 
conclusions  reached  above  are  unchanged. 

The  results  of  a  comprehensive  parametric  study  for 
the  speech  statistics  system  are  given  in  Figures  6,  7,  8, 
9,  and  10.   These  are  for  signal-to-noise  ratios  of  5.9,  9.0, 
11.0,  12,1,  and  13.0  decibels,  respectively.  Within  the 
range  of  values  shown,  the  effect  on  the  probability  of 
error  is  seen  for  any  combination  of  threshold  settings. 
The  optimum  thresholds  can  be  obtained  from  these  curves. 
As  can  be  seen,  the  optimum  thresholds  are  not  particularly 
critical,  in  the  sense  that  variation  in  the  vicinity  of 
the  optimum  point  does  not  increase  the  probability  of  error 
by  a  large  amount. 

The  variation  of  the  optimum  thresholds  with  signal-^ 
to-noise  ratio  is  given  in  Figure  11.   For  the  practical 
range  of  interest  Kp  has  the  approximately  constant  value 
of  0.7,  with  K,  slightly  greater.   For  a  reasonably  narrow 
range  of  signal-to-noise  ratios,  K,  and  K^  could  be  fixed 


,  FIGURE  6 

Probability  of  Error  for  Double  Tbreshold,  Speech.  Sta- 
tistics System  for  K^  Between  0  and  1.0,  and  for  Signal- 
to  Noise  Satio  5.9  Decibels 
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FIGURE  7 

Probability  of  Error  for  Double  Threshold,  Speech  Sta- 
tistics System  for  Kp  Between  0  and  1,0,  and  for  Signal - 
to-Noise  Ratio  9.0  Decibels 
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K, 


FIGURE  8 


Probability  of  Error  for  Double  Threshold,  Speech  Sta- 
tistics System  for  K^  Between  0  and  1.0,  and  for  Signal- 
to-Noise  Ratio  11,0  Decibels 
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FIGURE  9 

Probability  of  Error  for  Double  Threshold,  Speech  Sta- 
tistics System  for  Kp  Between  0  and  1.0,  and  for  Signal- 
to-Noise  Ratio  12.1  Decibels 
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FIGURE  10 
t 

Probability  of  Error  for  Double  Threshold,  Speech  Sta- 
tistics System  for  Kp  Between  0  and  1.0,  and  for  Signal- 
to-Noise  Ratio  13.0  Decibels 
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FIGURE  11 


Values  of  K,  and  Kp  for  Double  Threshold,  Speech  Sta- 
tistics System  for  Signal -to-Noise  Ratios  Between  ^.0 
and  14-. 0  Decibels,  with  Minimum  Probability  of  Error 
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beforehand.   The  degradation  would  be  slight  from  the 
variable  threshold  situation. 

The  other  quantities  of  interest  for  the  speech 

—   _        2 

statistics  system  are  K,  s,  and  <r   under  optimum  threshold 

conditions.   This  information  is  given  in  Figure  12.   For  a 
particular  signal-to-noise  ratio,  the  difference  between 
the  length  of  a  frame  and  the  value  of  K  gives  the  number 
of  slots  which  perhaps  could  be  used  in  some  other  manner; 

for  example,  in  the  transmission  of  non-real  time  data. 

_  2 

The  value  of  s,  along  with  cr     ,  gives  an  indication  of  the 

complexity  of  that  part  of  the  receiver  which  chooses  the 

one  of  the  s  possible  slots  as  the  signal  slot.   As  s  gets 

larger,  the  complexity  increases.  As  is  seen  in  Figure  12, 

s  is  between  1  and  2  for  the  range  of  interest  for  the 

optimum  settings,  with  small  variance.   The  indicated 

complexity  is  not  great. 

The  parametric  study  of  the  conventional  system  is 
depicted  in  Figure  15.  Here,  of  course,  only  one  threshold 
is  involved.   The  effect  on  probability  of  error  is  seen 
for  a  change  in  the  threshold,  for  a  wide  range  of  signal- 
to-noise  ratios. 

The  variation  of  the  optimum  threshold  vrLth  signal- 
to-noise  ratio  is  given  in  Figure  14.   It  is  very  close 
to  the  variation  of  K,  shovm  in  Figure  11  for  the  speech 
statistics  system. 


'  FIGURE  12 

—  -        2 

K,  s,  and  <r   for  Double  Threshold,  Speech  Statistics 

System  for  Signal-to-Noise  Ratios  Between  4.0  and  14.0 

Decibels,  with  Minimum  Probability  of  Error 
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'  PIGUHE  13 

ProlDability  of  Error  for  Single  Threshold,    Conventional 
Systen  for  K-,    Betv/een  0  and  1«0,    and  for  Signal-to- 
IToise  Hatios  3etv;een  5*9   and  16.0  Decibels 
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FIGURE  1^ 
Value  of  K,  for  Single  Tlireshold,  Conventional  System 
for  Signal -to-Noise  Ratios  Between  4.0  and  14.0  Deci- 
bels, with  Hinimiim  Probability  of  Error 
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Similarly,  a  parametric  study  of  the  largest  of  s 
system  was  carried  out,  and  tiie  results  plotted  in  Figures 
15,  16,  17,  and  18  for  signal-to-noise  ratios  of  9.0, 
11.0,  12.1,  and  13.0  decibels,  respectively.   As  before, 
the  effect  on  probability  of  error  of  change  in  thresholds 
is  easily  seen.   It  is  to  be  noted  that  the  curves  dip  for 
values  of  0  and  about  0.7  for  K2.   It  is  to  be  expected 
that  probability  of  error  \>;ould  decrease  as  the  upper 
threshold  increases  and  the  lower  threshold  approaches 
zero,  since  the  largest  of  s  system  approaches  the  largest 
of  iT  system.  However,  the  system  performance  is  almost  as 
good  if  the  optimum  threshold  is  taken  as  the  one  for  the 
second  dip  in  the  curve.   This  allows  the  value  of  s  to  be 
small,  \rLth   a  corresponding  decrease  in  complexity.   The 
variation  of  these  threshold  settings  is  shovm  in  Figure 
19.   Again,  these  could  be  fixed  beforehand  for  a  reasonably 
narrov;  range  of  signal-to-noise  ratios,  v^ith  only  small 
degradation  in  error  performance. 

For  this  system  also,  in  Figure  20,  the  variations 

—   —        2 

of  K,  s,  and  <r   are  given.   For  the  practical  range  of 

signal-to-noise  ratios,  the  values  are  not  significantly 
different  from  the  speech  statistics  system. 

This  completes  the  report  in  this  chapter  of  the 
study  of  the  two  sequential  systems,  the  conventional 
system,  and  the  largest  of  IT  system,  for  the  case  of  no 


PIGUHS  15 

ProbalDility  of  Error  for  Double  Threshold,  Largest  of 
s  System  for  Kp  Betvj'een  0  and  1,0,  and  for  Signal-to- 
Noise  Ratio  9.0  Decibels 
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FIGURE  16 

Probability  of  Error  for  Double  TtLresbold,  Largest  of 
s  System  for  Kp  Between  0  and  1,0,  and  for  Signal-to- 
Noise  Hatio  11,0  Decibels 
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I'IGURE  17 

ProbalDility  of  Error  for  DoulDle  Threshold,  Largest  of 
s  System  for  Kp  Between  0  and  1.0,  and  for  Signal-to- 
Noise  Ratio  12,1  Decibels 
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FIGIIR3  18 

Probability  of  Error  for  Double  Threshold,  Largest  of 
s  System  for  K^  Between  0  and  1.0,  and  for  Signal-to- 
Noise  Hatio  15.0  Decibels 
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FIGUEE  19 

values  of  K,  and  Kp  for  Double  Threstiold,  Largest  of 
s  System  for  Signal-to-Noise  Ratios  Between  ^.0  and 
14.0  Decibels,  with  Minimum  Probability  of  Error 
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FIGURE  20 

-  -       2 

K,  s,  and  <r       for  Double  Threshold,  Largest  of  s 

System  for  Signal~to~Noise  Ratios  Between  ^.0  and  1^.0 
Decibels,  with  Minimum  Probability  of  Error 
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impulse  noise.   Included  have  been  fairly  comprehensive 
studies  of  the  error  performance  of  each  system  under 
various  conditions.   The  1.5  decibel  improvement  over  the 
conventional,  for  the  speech  statistics  system,  would 
appear  to  be  small  under  most  circumstajices.  However, 
there  are  possible  situations  where  this  would  be  justi- 
fiably enough.   The  sequential  systems  provide  other 
choices,  other  than  the  conventional  and  largest  of  N. 
They  apparently  offer  a  compromise  between  the  simplicity 
of  the  former  and  the  error  performance  of  the  latter. 


CHAPTER  III 

CONVENTIONAL  AND  SEQUENTIAL  SYSTEMS  WITH  IMPULSE 

NOISE  CONSIDERATION 

Introduction 

The  QPPM  voice  systems  discussed  in  th.is  chapter  are 
considered  to  be  under  the  influence  of  narrow-band  Gaussian 
noise  and  an  impulse-like  noise.   The  impulse  noise  consists 
of  pulses  of  amplitude  B,  greater  than  the  signal  pulse 
amplitude  A.   It  arises  from  sources  external  to  the 
receiver.   The  noise  pulse  carrier  frequency  is  the  same  as 
the  signal  carrier.   Of  the  N-1  noise  slots  in  a  frame,  n 
will  be  considered  to  have  impulses  of  the  type  described. 
The  remainder  have  only  narrow-band  Gaussian  noise.   The 
probability  distribution  of  n  will  be  taken  to  be  Poisson 
for  purposes  of  this  discussion.   That  is, 

• 

v/here  X  is  the  average  number  of  impulses  per  frame.   This 
is  felt  to  be  representative  of  certain  special  communication 
situations.   Descriptions  of  the  systems  considered  and  the 
derivations  of  the  expressions  for  the  probability  of  correct 
decision  are  given  in  the  following. 

82 


83 
QPPM,  Four  Threshold,  Speech  Statistics 

This  system  is  fiinctionally  described  in  Figure  21, 
The  similaxities  between  Figure  1  and  Figure  21  should  be 
noted.   In  this  case,  the  output  of  the  envelope  detector 
is  compared  to  the  adaptive  thresholds  «,  b,  c,  and  d. 
Herfe,  a.   is  less  than  b,  b  less  than  c,  and  c  less  than  d. 
If  the  envelope  is  between  b  and  c,  the  receiver  chooses 
the  signal  hypothesis  H-,.   If  the  envelope  is  below  a  ,  or 
above  d,  the  noise  hypothesis  H  is  selected.   If  between  a. 
and  b,  or  c  and  d,  neither  hypothesis  is  chosen  at  this 
point.  The  remainder  of  the  receiver  processing  is  identical 
to  the  QPPM,  Double  Threshold,  Speech  Statistics  system  of 
Chapter  II,  shown  in  Figure  1.  Note  that  the  difference  is 
the  additional  noise  zone  and  the  additional  zone  of 
indifference. 

The  probability  of  correct  decision  is  again  a  sum 
of  three  contributing  terms.   That  is, 

Pi-(cor)  =  Pc  (correct,  signal  in  "signal"  zone) 

+  Pc  (correct,  signal  in  "possible  signal"  zone) 
+  Pc  (correct,  signal  in  "noise  alone"  zone) 

(3.2) 
If  the  signal,  in  the  t^^   slot,  is  in  the  "signal"  zone,  a 
correct  decision  will  be  made  if  none  of  the  preceding  j-1 
noise  slots  has  an  envelope  in  the  "signal"  zone.  Here  we 
are  interested  in  the  number  of  noise  impulses  in  the  j-l 
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slots,  rather  th.arL  in  the  total  N-1  noise  slots.   With  the 
Poisson  distribution  taken  here,  the  average  number  of 
impulses  in  j-1  noise  slots  is  (|Ei)^ •   ^^®  distribution  is 


-  ^5^^^=^  r^^^ ^  jV^=o.i.— j-l         (5.5) 

The  first  term  can  now  be  written 

P^  (correct,  signal  in  "signal"  zone) 


The  second  contributing  term  is  much  more  complex.  For  the 
signal  in  the  "possible  signal"  region,  the  reference  slot 
being  the/ii>  in  the  preceding  frame,  and  the  signal  slot 
being  the  jt'»,  a  correct  decision  requires  that  there  be  no 
noise  slot  closer  to  the  reference  than  the  signal  slot  is, 
with  envelope  in  the  "possible  signal"  region.   Three 
ranges  of  j  must  be  taken: 

0^i»/+l^a^2/,and  o^2/-hl. 
For  Q  less  than/,  there  are  2^-2j  slots  closer  to  the 
reference  than  the  signal  slot  is.   For  the  second  range  of 
values,  there  are  2j-2>C-l  slots  closer.   For  the  last  case, 
there  are  j-l  slots  closer.  With  n  impulses  assumed  for  the 
N-1  total  noise  slots,  q  are  assumed  to  be  within  the 
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"closer"  region.   The  maximum  allowable  value  for  q  is 
determined  by  the  number  of  slots  in  the  "closer"  region 
or  by  n,  whichever  is  smaller.  With  n  impulses  in  the  N-l 
noise  slots,  the  approximation  is  made  that  the  probability 
of  a  particular  noise  slot  having  an  impulse  is  :—^   .  Ve 
csua*  now  write 

Pc  (correct,  signal  in  "possible  signal"  zone) 


[i-«(f'§)^^(«'4)]^['-e-'-e-y^-!-^ 


/ 


S/vMlLfR  OF 


['■•(t««»'*.)]''['-^-*"'~'j"'""""' 
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S MA  LUSH.    OF 
^  VI, j-/ 


(5.5) 


If  th.e  signal  is  in  the  "noise  alone"  zone,  the  n  impulses 
and  the  N-l-n  noise  envelopes  must  be  in  the  "noise  alone" 
zone,  and  the  signal  slot  must  "be  the  center  one  to  lead  to 
a  correct  decision  by  the  receiver.   Therefore,  the  last 
term  is 

Pj-  (correct,  signal  in  "noise  alone"  zone) 


=  [l-Q(A,^),c5(4,^)].p^(^). 

Y\-0 


•[i-Q(|;'%)  +  <3(i'i)]  0.6) 
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Summing  the  contributions  of  equations  3.^,  3.5,  and  3.6 
gives  the  final  result 


+  ^[<'t)-«(4'l;)  +  «(#,-^)-fi(i'i)]- 


a/  ^  .    SMALUR    OF 


SfAAUBn    op 


Z  i'- 


J,  J, 


SMALLiU    OP 


90 


B  A_Mr,     -r^    -^^i^-'-r 


•2  Pg(h)-[i-e"^'^-"-He'''^-"7    • 


v»=o 


[,-Q(t.-|)^Q(t'i)r  C3.7) 


QPPM^  Four  Threshold,  Nearest  to  Reference 

The   similarities  "between  this  system,  in  Figure  22, 
and  the  system  of  Figure  5  should  be  noted.   The  four 
thresholds  a. ,  b,  c,  and  d  provide  an  additional  noise  zone 
and  an  additional  zone  of  indifference.   The  signal  hypothesis 
H,  is  chosen  if  the  envelope  is  between  b  and  c.   The  noise 
hypothesis  H  is  selected  if  the  envelope  is  either  below  oi 
or  above  d.   Neither  can  be  chosen  if  the  envelope  is  be- 
tween a.   and  b,  or  between  c  and  d.   The  receiver  processing 
is  identical,  from  this  point  on,  to  the  Double  Threshold, 
Largest  of  s  system,  with  one  exception.   At  the  end  of  the 
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frame,  when  tlie  receiver  has  been  unable  to  select  a 
hypothesis,  it  selects  as  the  signal  slot  the  one  whose 
amplitude  is  nearest  to  the  signal  zone,  b  to  c.   The 
Double  Threshold  system  selected  the  one  with  largest 
amplitude. 

'    The  probability  of  correct  decision  is  given  by 

Pg(cor)  =  Pg  (correct,  signal  in  "signal"  zone) 

+  Pg  (correct,  signal  in  "possible  signal"  zone) 
+  Pg  (correct,  signal  in  "noise  silone"  zone) 

(3.8) 
The  first  and  last  of  these  are  identical  to  the  corres- 
ponding terms  of  Pc(cor)  and  are  given  by  equations  5.^ 
and  3.6,  respectively.   With  the  signal  in  the  upper 
"possible  signal"  zone,  c  to  d,  the  noise  envelopes  must 
be  greater  than  it,  or  below  b  by  at  least  an  amount  equal 
to  the  amount  signal  exceeds  c.   If  this  amount  exceeds 
the  difference  in  b  and  a.   the  noise  envelope  only  has  to 
be  below  a.  With  the  signal  in  the  lower  zone,  a  to  b, 
the  noise  envelopes  must  be  less  than  the  signal,  or 
greater  than  c  by  an  amount  at  least  equal  to  the  amount 
the  signal  is  below  b.   If  this  amount  exceeds  the  dif- . 
ference  in  d  and  c,  the  noise  envelope  only  has  to  be 
above  d.   With  n  of  the  N-1  noise  slots  having  impulses, 
we  have 


9^ 


P^  (correct,  signal  in  "possible  signal"  zone) 

=  2  % M  •{  J|.- e '^^ I.  m  ['-<*(! 'f N) +«(#. .t)j' 


v\ro 


t  R^/ 


+ 

a. 


|^.e^'.Lr-§}-[.-«(l„.t)-«(l''W)j 


^ 


(5.9) 


where 


-f(P,)   rr     ^^<^   -t^^  3      P^<t>-^c- 


CL 


<rv, 
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i      /?a^  b+c  -CL.  ^3^-Lo) 


3(RJ  = 


k>  -)-  c    -  /?z  .       R     >     b-hc-d 


^^ 


;       "^i 


-   _d_  .        (<'     ^     b  •»-  c  -  d 


o;, 


.       R^^    bH-c-d  ^3^-Li) 
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Finally,  the  result  is 

N    J-l 


I  *-       a-    ■  • 


5^  ^  'B 
J=l   M=o 


•[,-e^"-"V .---']  .  [i-<«(#„,i).«(|,^jj 


e.'-*a'' 


fc  le*^* 


a. 


a  J^ -,N'i-y\ 


[i-€^"^^+e^"^^]  (5.12) 
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QP?M,  Single  Threshold 

It  is  of  interest  to  find  the  probability  of  correct 
decision  for  this  system,  already  discussed  and  described 
in  Figure  2,  when  impulse  noise  as  given  above  is  present. 
This  can  be  written  down  almost  immediately.   If  the  signal 
is  in  the  ^^   position  and  above  the  threshold,  the  preceding 
j-1  amplitudes  must  be  below  the  threshold.   A  correct 
decision  is  also  possible  if  all  amplitudes  are  below  the 
threshold,  if  the  signal  slot  is  the  center  one.   The 
probability  is 


[i-e^"'''J 


A/W 


b^  ,/j-/-vi      (3.13) 


Q:?PM,  Largest  of  N 

Also  of  interest  is  the  performance  of  this  system, 
in  Figure  ^,  with  impulse  noise.   A  correct  decision  requires 
that  all  noise  envelopes  be  of  smaller  magnitude  than  the 
signal  envelope.   Therefore,  the  probability  of  correct 
decision  is 
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v»=o      o 


i<>r 


j   •  ^Al         (5.14) 


QPPM,  Double  Threshold,  Non-Sequential 

This  system  is  identical  to  the  Single  Threshold, 
conventional  system  of  Figure  2,  except  for  the  addition 
of  an  upper  threshold  c.   It  is  shown  in  Figure  2$.   The 
signal  hypothesis  H,  is  chosen  when  the  envelope  is  between 
a.  and  c.   Otherwise,  the  noise  hypothesis  H  is  selected. 
The  receiver  processing  from  this  stage  on  is  the  same  as 
for  the  Single  Threshold  system. 

A  correct  decision  is  made  for  this  case  when  the 
signal  amplitude,  in  the  jib  slot,  is  in  the  "signal"  zone 
and  all  preceding  J-1  noise  envelopes  are  in  a  "noise" 
zone.  A  correct  decision  is  also  made  if  the  signal  slot 
is  the  center  one,  even  though  all  envelopes  fall  out  of 
the  "signal"  zone.   The  probability  of  correct  decision 
is 
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P/-)=  [Q(4't)-«(4-t)]-i  IPAi)-  P/M 


5  "    '8 


a  c 


2.     • 


J-/-)0 


+ 


N-l  _  


■['-Q(l't)  +  Q(|.t)]''    (3.15) 


QPPM,  Sinp:le  Threshold,  Larp^est  of  IT 

This  non-sequential  system  is  similar  to  the  system 
of  Figure  4.   It  is  shovm  in  Figure  24.   There  is  a  single 
threshold  c.  Any  envelopes  above  c  are  rejected  as  noise 
envelopes  and  hypothesis  H^  selected.   At  the  end  of  the 
frame,  all  envelopes  which  were  below  c  are  examined  and  the 
signal  selected  as  the  largest  one.   Of  course,  if  all  are 
above  c,  the  receiver  chooses  the  center  slot  as  the  signal. 
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A  correct  decision  requires  the  noise  envelopes  to 
be  either  above  c  or  below  the  signal  amplitude,  if  the 
signal  is  below  c.   Following  the  previously  used  procedure 
we  can  write 

•  [i  -  e '°'"  +  e  ^""-^  ]     ■<iR^ 


[• 


V)=0 


2. 
C 


-(A.-/->.),-.7 


(5.16) 


Discussion  of  Results 

In  order  to  obtain  niimerical  results,  the  value  of  X 
is  taken  as  one,  and  B  is  taken  as  three  times  the  signal 
pulse  amplitude  A.   A  more  general  study  would  allow  A 
and  B  to  be  variable,  but  the  preliminary  results  desired  , 
here  do  not  justify  the  great  increase  in  mathematical 
complexity  this  would  involve.   It  is  felt  that  the 
particular  case  chosen  for  evaluation  is  representative  of 
the  type  of  problem  which  would  arise. 


10^ 

Ihe   equations  Pg(cor)  ,  PgCcor)  ,  and  P,Q(cor) 
given  in  3.12,  5.1^»  and  5«16,  respectively,  involve  inte- 
grals which,  have  to  be  evaluated  by  approximation  methods. 
Appendix  B  shows  that  if  the  infinite  upper  limit  of 
PgCcor)  is  replaced  by  a  value  of  13.2,  the  error  involved 
is  less  than  10"-^  for  the  range  of  signal-to-noise  ratios 
considered. 

The  most  important  result  of  this  section  is  depicted 
in  Figure  25.   This  shows  the  variation  of  probability  of 
error  with  signal-to-noise  ratio  for  each  system,  with 
optimum  threshold  settings  considered.  Based  on  the 
mathematical  model  discussed  above,  it  is  seen  that  the 
conventional,  single  threshold  system  and  the  largest  of  IT 
system  have  very  poor  performance  levels.   Their  error 
probabilities,  Pn(err)and  Po(err),  respectively,  are  at  very 
high  values,  and  they  do  not  improve  substantially  with 
increased  signal-to-noise  ratio. 

The  conventional  system  with  an  added  upper  thres- 
hold, for  discrimination  against  the  impulse  noise,  is 
somewhat  better.   This  is  represented  by  Pq(err).   However, 
each  of  the  sequential  systems  gives  even  better  results.  , 
The  four  threshold,  speech  statistics  system  is  about  1.5 
decibels  better,  as  given  by  Pt-(err).   The  four  threshold, 
nearest  to  reference  system  is  about  2.0  decibels  better, 
as  given  by  Pg^(err).   The  single  threshold,  larges^.  of  N 


Probability  of  Error  for  Input  Signal -to-Uoise  Ratios 
Between  9*0  and  16.0  Decibels,  with  Impulse  Noise 
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A :^  DECIBELS 


2a-r, 
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system  performance  is  practically  the  same  as  the  four 
threshold,  nearest  to  reference  system  performance,  and  is 
slightly  "better.   This  is  given  by  P,Q(err).   However,  this 
system  is  more  complex  in  certain  respects.   On  the  average, 
the  receiver  must  select  one  out  of  lT-1  as  the  signal.   For 
the' four  threshold  systems,  however,  the  selection  would  he 
made  from  a  much  smaller  number.   Of  course,  most  of  the 
time  the  selection  process  need  not  be  resorted  to  for 
these  systems. 

As  was  the  case  for  the  systems  of  the  preceding 
chapter,  the  improvement  provided  by  sequential  systems 
over  the  modified  conventional  ones  is  relatively  small 
under  most  circumstances.   In  some  instances,  however, 
there  may  be  justification  for  paying  the  cost  of  the  in- 
creased complexity  for  this  improvement, 

A  parametric  study  of  the  four  threshold,  speech 
statistics  system  is  given  in  Figures  26,  2?,  and  28,  for 
the  case  of  signal-to-noise  ratio  of  12,1  decibels.   In 
order  to  limit  the  required  calculations  to  a  reasonable 
number,  the  value  of  K^  was  taken  to  be  0,6  and  0.?.   Based 
on  the  previous  results  it  is  felt  that  the  optimum  value  - 
of  K.  is  within  this  range.   Figure  26  shows  the  variation 
of  probability  of  error  with  changes  of  K-^   and  1^2 ♦  with  K^ 
and  K^  at  their  optimum  settings.   Figure  2?  has  K^  and  K^ 
changing,  with  Kp  and  K^  optimum.   Figure  28  has  K2  and  K^ 


PIGUHE  26 

Probability  of  Error  for  Four  Threshold,  Speech  Sta- 
tistics System,  with  a.   and  b  at  Optimum  Settings, 
for  Signal-to-Noise  Ratio  12.1  Decibels 
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EIGUSE  27 

Pro"batility  of  Error  for  Four  Threshold,  Speech  Sta- 
tistics System,  with  a  and  c  at  Optimum  Settings, 
for  Signal-to-Noise  Ratio  12.1  Decibels 
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EIGURE  28 

Probability  of  Error  for  Four  Tlireshold,  Speech  Sta- 
tistics System,  with,  a   and  d  at  Optimum  Settings, 
for  Signal -to-Noise  Hatio  12.1  Decibels 
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changing  v/ith  K-,  and  K^  optimum.   These  three  figures  show 
the  effects  on  error  probability  as  thresholds  are  varied 
from  their  optimum  settings. 

In  Figure  29,  the  optimxim  values  of  K^^   K2»  and  K-. 
are  sho'i-jn  as  a  function  of  signal-to-noise  ratio.   They 
are"  almost  constant,  and  could  "be  fixed  beforehand  with 
only  slight  error  degradation. 

Similarly,  for  the  four  threshold,  nearest  to  refer- 
ence system,  Figures  50,  51,  and  52  provide  the  results  of 
the  parametric  study  of  thresholds,  and  Figure  55  shows 
the  optimum  thresholds  for  various  signal-to-noise  ratios. 
These  curves  are  very  similar  to  the  preceding  group,  and 
require  no  further  comment. 

Figure  5^  shov;s  an  equivalent  set  of  curves  for  the 
conventional  system  with  a  single  threshold.   3ven  with 
an  optimum  setting,  as  given  in  Figure  55 »  "the  probability 
of  error  is  still  very  high. 

For  the  double  threshold,  non-sequential  case,  the 
threshold  study  was  performed  for  the  cases  of  signal-to- 
noise  ratios  of  9.0,  11.0,  12.1,  15,0,  and  16. 0  decibels, 
depicted  in  Figures  56,  57,  58,  59,  and  ^t-O,  respectively.  - 
The  minimum  points  can  be  easily  located,  and  thus  the  best 
threshold  constants  determined.   These  follov;  the  same 
pattern  as  those  previously  discussed,  in  that  they  are 
slowly  varying  with  signal-to-noise  ratio.   Figure  41 
illustrates  this , 


PIGURS  29 

Values  of  K-.  ,   K  ,  K-,   for  Four  Threshold,  Speech 
Statistics  System  for  Signal-to-Noise  Ratios  Between 
9«0  and  15,0  Decibels,  vath  Minimum  Probability  of 
Error 
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EIGURS  30 

Probability  of  Error  for  Four  Threstiold,  Nearest  to 
Reference  System,  v/ith.  a  and  b  at  Optimum  Settings, 
for  Signal-to-Noise  Ratio  12.1  Decibels 
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FIGURE  51 

Probability  of  Error  for  Pour  Threshold,  Nearest  to 
Heference  System,  v/ith  a  and  c  at  Optimum  Settings, 
for  Signal-to-Noise  Ratio  12.1  Decibels 
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FIGURE  32 

Probability  of  Error  for  Four  Threshold,  Nearest  to 
Reference  System,  vdth  a  and  d  at  Optimum  Settings, 
for  Signal-to-Noise  Ratio  12.1  Decibels 
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FIGURE  33 

Values  of  K,  ,  Kp,  K,  for  Four  Threshold,  Nearest  to 
Reference  System  for  Signal-to-Noise  Ratios  Between 
9,0  and  16.0  Decibels,  vdth  Minimum  Probability  of 
Error 
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FIGURE  54 

Probability  of  Error  for  Single  Threshold,  Imp\ilse 
Noise  System  for  K^'Kp'K,  Between  0  and  2.0  and  for 
Signal-to-Noise  Ratios  Between  9.0  and  15.0  Decibels 
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FIGURE  35 

Value  of  K, 'K^'K,  for  Single  Threshold,  Impulse 
L     d     y 

Noise  System  for  Signal-to-Noise  Ratios  Between 
9,0  and  16.0  Decibels,  and  witli  Minimum 
Probability  of  Error 
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FIGURE  36 

Probability  of  Error  for  Double  Threshold,  Impulse 
Noise  System  for  Z,  •Kp-K^.'K^  Between  0  and  1.0  and 
K, 'Kp  Between  1.0  and  3«6,  and  for  Signal -to-Noise 
Ratio  9*0  Decibels 
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FIGURE  37 

Probability  of  Error  for  Double  Threshold,  Impulse 
Noise  System  for  K^'Kp'K^'K^  Between  0  and  1.0,  ani 
K, 'Kp  Between  1.0  and  5.6,  and  for  Signal-to-Noise 
Ratio  11.0  Decibels 
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FIGURE  58 

Probability  of  Error  for  Double  Thresbold,  Impulse 
Noise  System  for  K,  •K2*K,'K^  Between  0  and  1.0,  and 
K,  •K2  Between  1.0  and  5.6,  and  for  Signal-to-Noise 
Ratio  12,1  Decibels 
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PIGUEB  39 

Pro"bability  of  Error  for  Double  Threshold,  Impulse 
Noise  System  for  K^  •£2*^5*^/1.  Between  0  and  1.0,  and 
^1*^2  S®*^®®^  ^'O  sind  5,6,  and  for  Signal-to-Noise 
Ratio  15.0  Decibels 
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PIGUSE  40 

Probability  of  Error  for  Double  Threshold,  Impulse 
Noise  System  for  K, 'Kp'K^'K^  Between  0  and  1.0,  and 
K, 'Kp  Between  1.0  and  5.6,  and  for  Signal -to-Noise 
Ratio  16.0  Decibels 
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FIGURE  ^1 

Values  of  K, -K^  and  K, 'Kp'K^'K^  for  Double  Threshold, 
Impulse  Noise  System  for  Signal-to-Noise  Ratios 
Between  9.0  and  15.0  Decibels,  with  Minimum 
Probability  of  Error 
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The  last  figures  represent  the  single  threshold, 
largest  of  N  system.   Figure  42  illustrates  clearly  how 
drastically  the  probability  of  error  depends  upon  the  value 
of  the  threshold  constant.   For  a  fairly  large  range  of 
values,  the  error  probability  is  not  greatly  affected. 
However,  once  outside  this  range  the  change  is  large  and 
rapid.  Again,  the  minimum  points  occur  at  approximately 
the  same  threshold  setting.   This  result  is  also  seen  in 
Figure  43. 

The  report  in  this  chapter  of  the  impulse-noise 
systems  is  now  complete.  Conventional,  modified 
conventional,  and  sequential  systems  have  been  studied 
rather  extensively  from  the  point  of  view  of  error 
performance  under  various  conditions  of  interference. 
Though  the  apparent  gain  from  the  sequential  systems  of 
up  to  2,0  decibels  is  small,  there  may  be  justification 
under  certain  conditions  for  using  these  techniques.  In 
any  case,  the  choice  is  available. 


FIGURE  42 

Probability  of  Error  for  Single  Threshold,  Largest 
of  N  System  for  ^■^''^2  J^etween  0.5  and  5.5,  and  for 
Signal-to-Noise  Ratios  Between  9.0  and  15.0  Decibels 
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FIGURE  43 

Value  of  K-, 'Kp  for  Single  Threshold,  Largest  of 
N  System  for  Signal -to-Noise  Ratios  Between  9.0 
and  16.0  Deci'bels,  and  with  Minimum  Probability 
of  Error 
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CHAPTER  IV 
CONCLUSIONS  AND  RECOMT'IENDATIONS  FOR  FUTURE  RESEARCH 

Conclusions 

The  studies  reported  here  are  for  conventional, 
modified  conventional,  and  sequential  quantized  pulse 
position  modulation  systems.   Based  on  these  studies,  for 
cases  with  and  without  impulse  noise,  it  appears  that 
added  complexity  required  for  sequential  techniques  in 
voice  applications  would  not  in  general  justify  their  use 
in  the  form  described  here.  Possible  exceptions  to  this 
statement  exist  v;here  there  are  special  circumstances, 
requiring  the  added  1,5  to  2,0  decibels  of  possible 
improvement  in  signal-to-noise  ratio, 

Nore  important,  it  is  felt,  is  the  fact  that  this 
research  represents  only  the  initial  effort  to  apply  Vald's 
sequential  techniques  to  voice  communications ,  When  these 
techniques  are  applied  to  other  modulation  methods,  perhaps 
in  forms  entirely  different  from  those  discussed  here,  the 
potential  improvement  may  be  high.   The  conclusion  is 
reached,  therefore,  that  more  research  should  be  performed 
in  this  area.   Recommendations  for  future  research  are 
given  in  the  following, 
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1^7 
Future  Research 

There  are  many  potential  areas  for  future  research 
in  connection  with  sequential  voice  communications 
techniques.   Some  of  them  will  he  discussed  in  the  following. 

All  of  the  work  reported  herein  dealt  with  the 
quantized  pulse  position  modulation  method.  It  would  appear 
desirable  to  find  out  if  similar  techniques  could  be  used 
advantageously  with  other  modulation  methods,  such  as  pulse 
code  modulation  (PCM),  quantized  frequency  modulation  (QFM), 
and  quantized  phase  modulation  (QpM). 

The  speech  probability  functions  used  here  were 
derived  from  somewhat  limited  experimental  data,  considering 
the  fact  that  only  three  talkers  were  involved.   The  use  of 
many  talkers  to  arrive  at  a  set  of  speech  statistics  might 
lead  to  a  change  in  the  result.  Also,  a  particular  appli- 
cation, such  as  military,  might  require  the  use  of  a 
somewhat  specialized  vocabulary  in  obtaining  the  functions. 
This  should  be  studied. 

Several  direct  extensions  of  the  work  here  are 
possible.   Under  some  conditions  it  might  be  desirable  to 
compare  the  systems  on  the  basis  of  output  signal-to-noise  ' 
ratio,  rather  than  probability  of  error.   The  analytical 
relationship  between  these  two  quantities  would  be  of 
interest.   Also  of  interest  is  the  relationship  between 
speech  intelligibility  and  probability  of  error  for  each  of 
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the  systems.   Finding  of  this  would  involve  an  experimental 
program  of  fairly  large  proportions.   The  tradeoff  between 
"bandwidth  and  probability  of  error  would  also  be  of  value. 

The  possibility  of  transmitting  non-real  time  data 
over  a  portion  of  the  frame  has  been  mentioned  previously. 
Much  research  is  required  before  this  would  be  possible. 
A  comparison  of  the  benefits,  if  any,  of  using  error- 
correction  codes  with  voice  to  the  benefits  of  sequential 
techniques  would  be  in  order.   The  amplitude  of  the  impulse- 
like noise  has  been  considered  constant  here.   It  v;ould  be 
desirable  to  consider  the  effects  of  variable  amplitude, 
with  a  suitable  probability  density  function  for  the 
amplitude.  Similarly,  the  threshold  settings  are  taken  as 
constant  during  a  frame.   Better  performance  might  result 
from  a  setting  that  varied  from  slot  to  slot.   It  seems  a 
difficult  task  to  evaluate  this. 

The  systems  here  have  all  operated  on  exclusive 
frequency  channels.   The  same  techniques  have  application 
in  co-channel,  frequency-time  matrix  coded  systems.   The 
results  have  not  yet  been  evaluated  for  this  application. 

As  is  probably  obvious  from  the  above  paragraphs, 
there  are  still  many  SLreas  ;>rhich  need  to  be  explored  in 
connection  with  applying  Vald's  sequential  techniques  to 
voice-  communication  problems.   This  report  represents  only 
the  beginning. 
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APPENDIX  A 
Speech.  Probability  Functions 

This  appendix  describes  the  mathematical  model  used 
in  this  report  for  the  marginal  and  conditional  probability 
functions  for  conversational  speech.  Here  we  are  concerned 
with  the  statistics  of  speech  in  its  entirety,  rather  than 
with  statistics  of  individual  speech  sounds. 

The  experimental  data  which  provide  the  basis  for 

12 
this  model  were  obtained  by  Davenport.    He  was  concerned 

with  W^(x),  the  first  probability  density  function  of  the 

instantaneous  speech  amplitude,  and  with  W2(x, /xp^T),  the 

conditional  density  for  amplitude  x,  when  the  value   T 

seconds  before  was  -x.^* 

Considering  first  W-,(x),  it  is  seen  that  it  consists 
of  two  parts.   There  is  a  spike  of  approximately  Gaussian 
shape  which  represents  the  unvoiced  sounds.   This  part  of 
the  function  is  significant  only  for  small  amplitudes. 

Superimposed  on  this  is  a  function  which  represents 
the  voiced  sounds.   This  is  approximately  exponential. 
Davenport  gives  as  the  result 
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v/here  the  random  variable  has  been  normalized  so  as  to  have 
a  mean  square  value  of  one.   The  approximate  values  for  cr. 
and  o^  are,  respectively,  1.23  and  0.118. 

With  this  function  the  probability  is  about  0.003 
that  the  instantaneous  speech  amplitude  will  exceed  a  value 
of  four.   Therefore  the  maximum  amplitude  with  which  we 
must  deal  is  selected  as  four.   The  range  of  values  from 
minus  four  to  plus  four  is  to  be  quantized  into  N  levels, 

Q 

of  length  ^  each.   The  result  for  the  probability  that  the 
speech  amplitude  will  be  in  the  jti>  position  when  applied 
in  a  quantized  pulse  position  modulation  system  is 

Performing  the  integration  leads  to 

P5(j)=o-3[-e        ^e.  J 


o..[erf{j(^V^}-erf{(r»K^^j-;^^]] 


(A,3) 


F 


Where  the  upper  sign  is  to  be  used  for  1  i$  j  ^  ^  and  the 
lower  sign  for  ^  +  1  .$  j  ^  N  . 

The  available  data  for  W2(x-|_ jx2,r)  are  for  the  case 
of  f  equal  to  92  microseconds.   Based  on  a  sampling  frequency 
of  8000  samples  per  second,  the  speech  sampling  period  is 
125  microseconds.  W2(x,  (x2,r)  is  approximately  exponential 
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for  the  case  shown.   The  same  shape  will  be  taken  for  X 
equal  to  125  microseconds  with  the  peak  of  the  density- 
function  reduced.   The  peak  occurs  at  x-,  equal  to  Xp  .   As 
Xp  gets  further  from  the  center  position  the  value  of  the 
peak  goes  up,  according  to  Davenport's  results.   This  factor 
is  taken  into  account  by  the  fact  that  the  end  points  of 
the  density  function  must  be  clipped  off  because  of  the 
finite  length  of  the  sample  interval.   The  required 
normalizing  factor  becomes  larger  as  x^  moves  further  from 
the  center. 

The  probability  that  the  speech  sample's  amplitude 
corresponds  to  the  jib  position,  given  that  the  previous 
position  v/as  the^f  iiJ,  is  thus  given  by 

PsW)  -  ^ ; ^^-^^ 

where  x,  and  Xp  must  be  replaced  by  their  corresponding 
values  of  j  and^  .   That  is. 

The  approximately  correct  expression  for  Wp(x/xp)  is 

W^(x/x;,)^  0.5--e  ''"''  (A.6) 


Substituting  these  leads  to 


s^^X 


J.   "  -"-^J 


8-J(^)-H^ 


.-'i/l 


¥■ 

2-Ii-e^] 
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Pc('/1^  ''-'^t^., CA.7) 


The  final  result  of  this  integration  is 


z-i^-li^^-'W^^-^C-i)] 


^     J 


-i 


CA.8) 


APPENDIX  B 
Error  Bound  for  Approximate  Evaluation  of  the  Integral  in 


PgCcor) 


The  probability  PgCcor)  includes  the  integral 

,   •  ['  -  e  ^'-^  ]     ■  J*?-  (B.l) 

This  integral  must  be  evaluated  by  approximate  methods,  re- 
quiring a  finite  upper  limit  of  integration.  The  limit  will 
be  determined  so  that  we  can  replace  the  above  integral  with 


j^.e^.r.(d4.).[,-,(^^,^^)f. 


The  error  involved  by  this  substitution  is 


(B.2) 


Now, 


•[l-e="-*J     .J/?, 


(B.5) 


(B.^) 


15^ 
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and 


-  ^a  ,A/-/-V1 


An  upper  bound  of  the  error  is  therefore  given  by 
.   Err  ^  r^,  .  e-  ^'.  I^  (Afi)  .  JR, 


-  <2  (4'4)  <^-^) 


_5 
If  the  magnitude  of  the   error  is  to  be  no  greater  than  10  '^j 

we  have  to   solve 

q(-^,|;)     =    O.OOOOI  CB.7) 

As  A/o-  increases,  the  value  of  H/<r  also  increases.   Taking 
the  largest  value  of  A/<r  that  is  of  interest  in  this  report, 
that  is 

we  get 

Q  (^'^^    -^)^  O.OOOO/  (B.9) 

The  solution  yields  the  desired  value 

IL  c::    [^   o  (B.IO) 
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